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Abstract 

This study is the first social validity evaluation of the Spanish version of the FRIENDS for Life program with 
Mexican children. FRIENDS for Life is a cognitive-behavioral intervention aimed at increasing social and 
emotional competence and decreasing anxiety and depressive symptoms in children. The program is designed to 
empower children and families by teaching relaxation techniques, coping and interpersonal skills, and positive 
thinking. Participants were 498 students, ages 9 to 11. Upon completion of the program, students, parents, and 
teachers were surveyed regarding their perceptions on the utility and enjoyability, and their global satisfaction. 
Results indicate that students, parents, and teachers evaluate the program as helpful and enjoyable. Gender 
differences were found, girls reported the program as more useful and enjoyable than boys. The skill that students 
and parents found more useful was changing negative thoughts into positive, and positive correlations were also 
found between level of satisfaction and outcome measures. 
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1. Introduction 

Effective intervention programs are those that are not only cost and time effective but also involve the active 
participation of all consumers. It is important for applied researchers to know if the behavioral goals selected for 
study are significant, if the procedures are appropriate, and if the effects produced are important for clients and 
society; in other words, to know how participants perceive the intervention termed as “social validity”(Fawcett, 
1991). 

Wolf (1978) talks about social validity as a subjective measurement that is important to consider in behavioral 
analysis; he argues that “social importance is a subjective value judgment that only society was qualified to make” 
(Wolf, 1978; pp. 206-207). If the purpose is to evaluate social importance, society would need to validate the 
interventions on three levels: a) the social significance of the goals, b) the social appropriateness of the procedures; 
that means that we need to know if the participants, caregivers and other consumers consider that the intervention 
is acceptable or not, and c) the social importance of the effects; that is, if consumers are satisfied with the results 
(Wolf, 1978). 

It is better to think of social validity as a process, rather than a result or outcome, so it can be assessed at several 
stages in the intervention process (Lawcett, 1991). The level of satisfaction with intervention procedures is usually 
assessed by using self-report questionnaires that should include the different elements that might contribute to the 
variance in satisfaction rating (Loster & Mash; as cited in Barrett, Shortt, Lox, & Wescombe, 2001). Schwartz and 
Baer (1991) suggested evaluating a specific component and also an overall rating of satisfaction. There is a need 
for more research to understand the relationship between intervention acceptability and outcome. 

All interventions should ideally include a social validity evaluation, especially those designed to work in the areas 
of social and emotional development and prevention of anxiety and depression. Prevention of anxiety and 
depressive disorders is very important as these are common problems among children that, if left untreated, may 
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lead to a broad range of negative consequences for the child and his or her family (Kashani & Orvaschel, 1990; 
World Health Organization, 2004). Findings from this study revealed that at pretest almost two out of 10 Mexican 
children were experiencing some symptoms of anxiety or depression. A recent study conducted by Benjet, 
Borges, Medina-Mora, Zambrano, and Aguilar-Gaxiola (2009) has reported even higher rates of anxiety and 
depression among Mexican youth, suggesting that these problems escalate over time. It was estimated that about 
40% of Mexican youth had experienced a mental health problem, anxiety was the most common, followed by 
impulse-control disorders, affective disorders and substance abuse (Benjet, et al., 2009). The later study also 
found that only 14% of the adolescents who reported a mental health problem received help. Therefore, research 
on the prevention of anxiety and depression in developing countries such as Mexico is crucial (Caraveo-Anduaga 
& Comenares-Bermudez, 2002). 

Research into universal school-based prevention for anxiety and depression has increased during the last decade 
yielding promising results (Dozois & Westra, 2004; Gladstone & Beardslee, 2009; Neil & Christensen, 2009; 
Patel & Sumathipala, 2001, World Health Organization, 2004). Cognitive-behavioral intervention (CBT) has been 
regarded as one of the most effective interventions and involves teaching skills at physiological, behavioral and 
cognitive levels (Barrett, 2000; Compton, Burns, Egger & Robertson, 2002; Cooper, 2007; Kendall, Chu, Pimentel, 
& Choudhury, 2000; Kendall & Suveg, 20006; Manassis, 2000; Waddell, Godderis, Hua, McEwan, & Wong, 
2004). While several programs have been researched, by and large the most extensively researched program 
designed to promote children's emotional resilience is the FRIENDS for Life program (Barrett, 2008), a brief CBT 
intervention (Fisak, Richard, & Mann, 2011). 

Studies of the effectiveness of the FRIENDS for Life program have been conducted at the universal, selective, and 
indicated level of prevention (i.e, Barrett & Turner, 2001; Lowry-Webster, Barrett & Dadds, 2001; Lock & 
Barrrett, 2003, Barrett, Farrell, Ollendick & Dadds, 2006, Stallard, Simpson, Anderson, Osborn & Bush, 2005). 
However, only three of them have focused on evaluating the social validity of the program. 

Barrett, Shortt, Fox, and Wescombe (2001) conducted the first study evaluating the social validity of the FRIENDS 
for Life program. In their study they included in the treatment groups 55 children and 12 adolescents with a 
principal diagnosis of generalized anxiety disorders, separation anxiety disorder or social phobia. Parents, 
adolescents, and children were surveyed over time about their global satisfaction with the program, acceptability 
of treatment components, and the completion of homework tasks. Clinical outcome measures were also completed 
post treatment. Children completed the Revised Children's Manifest Anxiety Scale (RCMAS), parents were asked 
to complete the Diagnostic Interview Schedule for Children, Adolescents and Parents (DISCAP), and mothers 
completed the Child Behavior Checklist (CBCL) and the Depression, Anxiety and Stress Scale (DASS). Results 
indicated a high level of satisfaction with the FRIENDS program and a high completion rate of homework tasks. 
Children rated cognitive skills as more useful than adolescents did, and adolescents reported behavioral strategy of 
graded exposure as more useful than other strategies. No significant relationship was found between treatment 
acceptability and clinical outcomes. 

The study by Essau, Conradt and Ederer (2004) evaluated the social validity of the German version of the 
FRIENDS for Life program implemented as a universal prevention strategy for 208 children ages 9 to 12. Children 
were asked to complete the Spence Children's Anxiety Scale (SCAS), the Depression subscale of the Revised 
Child Anxiety and Depression Scale (RCADS), and the FRIENDS Child Social Acceptability Measure translated 
in German. Parents were asked to complete the FRIENDS Parent Social Acceptability Measure. Results showed 
that children and their parents were highly satisfied with the program. Children’s attendance and completion of 
homework tasks were very high. Both, children and parents, rated relaxation exercises and thinking helpful 
thoughts as the more useful skills learnt in the program. Treatment acceptability was correlated significantly with 
children's clinical outcome. 

And lastly, the study by Cooper (2007) evaluated the social validity of the FRIENDS for Life program 
implemented as a universal prevention program with 29 fourth-grade children, ages nine and 10, from a suburban 
school in Canada. Social validity questionnaires were developed by the author of this study, students' perception 
was assessed weekly and upon completion of the program. Students' reported that the program was easy to 
understand; a bit helpful and about 90% completed all the homework activities. The overall final evaluation 
reported that they enjoyed the program, 85.7% would recommended to others, it was helpful for them, and 71.4% 
reported that the program might have been a bit helpful to other children in their classroom. Relaxation techniques, 
deep breathing and thinking helpful thoughts were the skills found to be more useful; on the contrary, the 6-blocks 
problem solving plan, recognizing feelings in other, and making others feel good were the skills rated as least 
useful. Females were found to enjoyed more the program, completed higher percentages of homework tasks, and 
found the skills learnt more useful and helpful for them and for their classmates, when compared to boys. 
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The purpose of the current research was to evaluate the social validity of the Spanish version of the FRIENDS for 
Life program (called AMISTAD paraSiempre ), a social and emotional skills program implemented as a universal 
school-based strategy for the prevention of anxiety and depression in Mexican primary school-aged children. 
Specifically, three areas of social validity were examined: (1) The extent to which consumers (students, parents, 
and teachers) are satisfied with the program, with a detailed assessment of the intervention components, (2) the 
extent to which there are gender differences in the ratings of techniques and skills learnt in the program, including 
cognitive and behavioral techniques, and (3) the possible relationship between the level of students' satisfaction 
with the program and the intervention outcomes, with the hypothesis that a high level of satisfaction is correlated 
with a high level of improvement in outcome measures. 

2. Method 

2.1 Participants 

All participants in this study were taken from a larger research project designed to evaluate the effectiveness of the 
program AMISTAD porsiempre for primary school-aged children in Mexico (Gallegos, Linan-Thompson, & Stark, 
2011). In total, participants were 498 fourth and fifth grade students from four public schools from a city in the 
Northern part of Mexico. The mean age of participants was 9.78 (SD=0.82), 54.5% (n=271) of these students were 
in grade 4 and 45.5% (n=227) were in grade 5, 49% (n=246) were boys and 51% (n=252) were girls. Participants in 
this study also included the 15 classrooms teachers that implemented the program and 115 parents of children who 
received the program. 

2.2 Measures 

2.2.1 Social Validity Measures 

Social validity measures were administered after the completion of the intervention to each of the program 
consumers: students, parents and teachers. 

Social Validity Questionnaire for Children (Barrett, 2005). For this study, the questionnaire was translated into 
Spanish. The questionnaire was comprised of seven questions. Using a 4-point scale from 1 (a lot/all the time) to 4 
(not at all/ nothing at all). The first five questions related to how enjoyable the program was, how much did they 
leant by doing the program with their classroom friends, how much did they leant about feelings and coping skills, 
and how often do they use the skills learnt in the program. The sixth question asked students to choose which skills 
they found more useful from the nine options presented. Finally, the seventh question was an open-ended question 
for those children that wanted to make any comment. 

Social Validity Questionnaire for Parents (Barrett, 2005). For this study, the questionnaire was translated into 
Spanish. The questionnaire was comprised of eleven questions. The first nine questions used 4-point scale from 1 
(a lot/all the time/very useful) to 4 (not at all/ nothing at all/not useful at all). Two of the questions asked how 
useful they thought positive coping-skills programs were and how important will it be to incorporate a program 
like this into the school curriculum. Two questions related to how useful the skills were to themselves as parents 
and how much did they learn about enhancing their child's coping skills. Four questions related to how much they 
thought their child learnt about feelings and coping skills, how much they thought their child enjoy the program, 
and how often did their child use the ideas and skills learnt in the program. Question 10 asked parents to choose 
which skills their child found more useful from the nine options presented. Question 11 was an open-ended 
question that asked to provide any other feedback (positive or negative) that they had. 

Social Validity Questionnaire for Teachers (Barrett, 2005). For this study, the questionnaire was translated into 
Spanish. The questionnaire was comprised of ten questions. The first nine questions used 4-point scale from 1 (a 
lot/very useful/very easy/very well/very complimentary) to 4 (nothing at all/ not at all useful/very difficult/not well 
at all/not complimentary at all). Two of the questions asked how useful they thought positive coping-skills and 
resilience programs were for children and young people, how well did the program complement the existing 
curriculum, and how complimentary was the AMISTAD porsiempre philosophy to the school's overall teaching 
philosophy. Two questions related to how much did they leant about enhancing resilience in children and 
adolescents and how easy was to implement the program in their classrooms. Four questions related to how useful 
was the program for enhancing the resilience of the children in their classrooms, how much did their students learn 
about feelings and coping skills, and how much they thought their students enjoyed the program. Question 10 was 
an open-ended question that asked teachers to provide any other feedback (positive or negative) that they had. 

2.2.2 Intervention Outcome Measures 

Three measures were administered collectively to all children to determine the severity of anxiety and depressive 
symptoms, risk status for anxiety and depression, and coping skills. 
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Spence Children’s Anxiety’ Scale(SCAS)( Spence, 1997). The Spanish version was administrated. A self-report 
measure of anxiety designed for use with children 8-12 years. The SCAS consists of 44 items, 38 of which assess 
specific anxiety symptoms (e.g. symptoms of social phobia, separation anxiety, panic attack and agoraphobia). 
The remaining 6 items serve as positive “filter items” in order to reduce negative response bias. Children are asked 
to rate, on a 3-point scale ranging from never (0) to always (2), the frequency with which they experience each 
symptom. This measure has showed sound psychometric properties including a reliability coefficient of 0.91 
(Bermudez-Ornelas & Hernandez- Guzman, 2002). The total score of this measure was used in the current study. 
Participants scoring 41 or above on the SCAS were considered to be “at risk” for anxiety. This cut-off number was 
calculated by adding the pretest mean score to 1 SD of the sample of the study by Gallegos, Linan-Thompson and 
Stark (2011). 

Children’s Depression Inventory’(CDT) (Kovacs, 1981). The Spanish version was administrated. A self-report 
measure used for depressive symptoms in children aged seven to 17 years. The CDI has 27 items related to the 
cognitive, affective and behavioral signs of depression. Each item contains three statements, and children select the 
one statement that best describes them in the past two weeks. Statements within each item are scored according to 
the severity of children's symptoms: no symptomatology present (0), mild symptomatology (1), or severe 
symptomatology (2). A total score is calculated by summing the statements chosen by the students. The statement 
(item nine) that assessed suicidality was removed. The CDI has shown good psychometric properties: a 
Cronbach’s alpha reliability coefficient of 0.94 and a test-retest reliability coefficient of 0.87, and adequate 
construct and content validity (Del Barrio, Moreno-Rosset, & Lopez-Martmez, 1999). Children scoring 15 or 
above on the CDI were considered to be “at risk” for depression. This cut-off number was calculated by adding the 
pretest mean score to 1 SD of the sample of the study by Gallegos et al., (2011). 

Cuestionario de Afrontamiento (Hernandez- Guzman, 2003). Is a Spanish self-report measure developed and 
standardized in Mexico to assess coping skills in children aged 6 to 12 years. The scale has 12 items related to 
child's interpretation and reactions when facing a problem, and the things he or she does to cope and/or solve the 
problem. Children are asked to rate, on a 3-point scale ranging from never (0) to always (2), the frequency with 
which they experience each statement. Lower scores reflect a more proactive positive coping. The questionnaire 
assesses coping responses to situations perceived as stressful and provides information on three factors: active 
coping, emotional coping, and passive or avoidant coping. The Cuestionario de Afrontamiento has demonstrated 
adequate psychometric properties including a Cronbach’s alpha reliability coefficient of 0.67 (Hernandez- 
Guzman, 2003; Hernandez-Guzman, et ah, 2010). 

2.3 Design and Procedure 

A cross-sectional and correlation study was conducted to evaluate the social validity of the intervention. 

Before initiating the program participating children completed the intervention outcome measures during the 
school day (pretest). Teachers and psychologists from the office of Gabinetes de Servicios Educativos (Office of 
Educational Services), a unit within the Special Education Department of the State, read the instructions and test 
items aloud to all students, and students answered the questions. Students were informed that all responses were 
confidential. Classroom teachers from the participating schools were released from their classrooms for a two day 
training covering the principles and practices of prevention and early intervention. The training provided a 
step-by-step guide to the intervention program, the AMISTAD para Siempre program (Barrett, 2008a, 2008b). 

Following the pretest phase and the training workshop, the program was implemented for 10 consecutive weeks, 
with one 75 minute session completed once per week. Students were tested at the completion of the 10 th session 
with same intervention outcome measures and a social validity questionnaire. Parents and teachers were also asked 
to complete the social validity questionnaires after the completion of the program. 

2.4 Inter\’ention Protocol and Materials 

AMISTAD para Siempre (Barrett, 2008a, 2008b), the culturally adapted Spanish version of the FRIENDS for Life 
program, is a social and emotional program designed to enhance resilience in children. It incorporates 
physiological, cognitive, and behavioral strategies to assist children in coping with stress and worry. The 
behavioral component includes the monitoring of feelings and thoughts, out-of-session and mental imagery 
exposure and relaxation training. The cognitive component teaches children to recognize their feelings and 
thoughts and the link between them. It also teaches students to identify faulty cognitions and incompatible 
self-statements, and to elaborate alternative interpretations of difficult situations. Learning techniques include 
group discussion, hands-on activities, and role-play. Approximately one session is dedicated to learn each of the 
seven steps represented by the FRIENDS acronym. The Spanish acronym is parallel to the English in terms of the 
concepts taught. After the introductory session, children start to leant the letter F, which stands for “Feeling 
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worried?” followed by the letter R “Relax and feel good”, I “Inner helpful thoughts”, E “Explore solutions and 
coping plans”, N “Nice work; reward yourself’, D “Don't forget to practice” and S “Smile and stay calm”. Within 
each session, the teacher uses modeling of the skills, and after the skills are taught, children have opportunities to 
practice in small groups and debrief with the whole classroom. The program encourages the building of social 
support groups and respect for diversity. There are two informational sessions for parents with duration of about 

1.5 hours each. In these sessions parents learn about the skills and techniques taught in the program, about the 
importance of family and peer support, and the promotion of the practice of problem solving rather than avoidance 
of anxiety-provoking situations. 

Group leaders received a copy of the AMISTAD para Siempre: Manual para Lideres de Grupo (Barrett, 2008b) 
that describes the goals and strategies for each session, the desired outcomes, and the specific exercises to be used 
in meeting these outcomes. Participants from the intervention group received a copy of the AMISTAD para 
Siempre: Cuaderno de Trabajopara Ninos (Barrett, 2008a). The workbook allowed participants to practice the 
skills. Homework activities provided them with an opportunity to reinforce and generalize the skills and practice 
with their family. 

2.5 Statistical Analysis 

Means, standard deviations, frequencies and percentages were calculated for each item of the social validity 
questionnaires. Chi-square analyses were conducted to examine possible gender differences in the skills that 
students found more useful. Independent sample /-tests (alpha level 0.05) were performed for each item of the 
students' social validity questionnaire in order to examine the presence of gender differences. Pearson correlations 
(alpha level 0.05) were conducted to examine the relationship between the level of students' satisfaction and the 
direction of intervention outcomes. 

3. Results 

3.1 Students ’ Satisfaction with the AMISTAD Para Siempre Program 

Table 1 displays the students' responses by gender to questions regarding how much they enjoyed the program, 
how much did they learn, and how often do they practices the ideas and skills learnt in the program. Overall, 
students evaluated the program as enjoyable and helpful in enabling them to cope with difficult situations; 90% 
indicated that they enjoyed the program a lot, 50% reported that they used the skills learnt all of the time and 44% 
of some of the time. 


Table 1. Students' means by gender for each of the items of the Social Validity Questionnaire (4 A lot / All the time, 
1 Not at All/ Nothing at All) 


Question 


Boys 



Girls 



M 

SD 

n 

M 

SD 

n 

1. How much did you enjoy the FRIENDS 

program? 

3.83 

.484 

246 

3.90 

.344 

252 

2. How much did you leam by doing the program 

with your classroom friends? 

3.58 

.639 

246 

3.72 

.524 

252 

3. How much did you leam about feelings? 

3.64 

.654 

247 

3.85 

.465 

252 

4. How much did you leam about how to cope 

with feeling worried or upset? 

3.60 

.719 

247 

3.70 

.569 

251 

5. How often do you use the ideas and skills 

learned in the FRIENDS program? 

3.37 

.697 

247 

3.48 

.589 

250 


Independent sample t-tests revealed statistically significant gender differences, indicating that girls reported the 
program as more useful and enjoyable, when compared to boys. Question 1, How much did you enjoy the 
FRIENDS program [t (1,498) = -2.11, p = .04], Question 2, How much did you learn by doing the program with 
classroom friends? [/ (1,498) = -2.69, p = .007], Question 3, How much did you learn about feelings? [/ (1,498) = 
-4.79, p = .001], and Question 5, How often do you use the ideas that you learn in the FRIENDS program? [1 (1,497) 
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= -1.99, p = .047], No statistically significant differences were found for Question 4, How much did you leant 
about how to cope with feeling worried or upset? [t (1,497) = -1.62, p = .107], 

Frequencies and percentages of the skills that students found more useful appear on Table 2. On average students 
endorsed 5.88 items. The two coping skills taught that students found more useful were changing negative 
thoughts to positive thoughts (82.2%) and relaxation exercises (80.4%). The two least helpful skills taught were 
recognizing feelings in yourself (59.8%) and helping others to feel good (42.6%). 

Table 2. Students' ratings of the skills they found more useful 

Skill 

Overall 

Boys 

Girls 


%(n) 

% (n) 

%(n) 

Relaxation exercises 

80.4% (402) 

79.8% (197) 

81% (205) 

Deep breathing 

62.4% (312) 

65.2% (161) 

59.7% (151) 

Thinking helpful thoughts 

67.4% (337) 

67.6% (167) 

67.2% (170) 

Changing negative thoughts to 

positive thoughts 

82.2% (411) 

85% (210) 

79.4% (170) 

Step plan 

73.4% (367) 

74.5% (184) 

72.3% (183) 

6-Block problem solving plan 

61.2% (306) 

60.3% (149) 

62.1% (157) 

Recognizing feelings in yourself 

59.8% (299) 

57.5% (142) 

62.1% (157) 

Recognizing feelings in others 

79.4% (397) 

76.5% (189) 

82.2% (208) 

Helping others to feel good 

42.6% (213) 

42.5% (105) 

42.7% (108) 

Chi-square analysis revealed no statistically significant gender differences in the ratings of skills, the following 
statistics were reported on table 3. 

Table 3. Chi-square comparison between genders in the ratings of skills. 



x 2 

df n 

p Value 

Relaxation exercises 

0.13 

1 401 

>.05 

Deep breathing 

1.61 

1 311 

>.05 

Thinking helpful thoughts 

0.01 

1 336 

>.05 

Changing negative thoughts to helpful thoughts 2.65 

1 379 

>.05 

Step plan 

0.3 

1 366 

>.05 

6-block problem solving plan 

0.16 

1 305 

>.05 

Recognizing feelings in yourself 

1.08 

1 298 

>.05 

Recognizing feelings in others 

2.48 

1 396 

>.05 

Helping others to feel good 

0.01 

1 212 

>.05 


3.2 Parents ’ Satisfaction with the AMISTAD Porsiempre Program 

There were two informational sessions offered for parents during the implementation of the FRIENDS program. 
The mean number of sessions attended was 1.59 (SD=0.71), 52.6% of the parents attended to the two sessions, 
44.1% attended only one session, and 3.3% did not attended to any sessions. Table 4 displays the parents' 
responses each of the items of the social validity questionnaire. Overall, parents reported that the program was 
useful for them and for their children; 74 % indicating that they leamt a lot about enhancing their child's coping 
skills and 87.3% reported that the program was very useful for enhancing their child's coping skills. 
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Table 4. Parents' means for each of the items of the Social Validity Questionnaire (4 Very useful/ Very 
Important/A lot/ All the time, 1 Not at all Useful/Not at all Important/ Nothing at All/ Not at All) 


Question 

Mean 

SD 

N 

1. How useful do you think positive coping-skills programs are 

in general? 

3.97 

.256 

115 

2. How useful do you find the FRIENDS program for 
enhancing your child’s coping skills? 

3.87 

.363 

115 

3. How important do you think it is that your child’s school 

incorporates a program like this into the curriculum? 

3.97 

.184 

115 

4. How much did you learn about enhancing your child’s 

coping-skills? 

3.71 

.528 

116 

5. How much do you think your child learned about 

understanding feelings in themselves and others? 

3.66 

.620 

116 

6. How much do you think your child learned about coping with 

these feelings? 

3.52 

.640 

115 

7. How much do you think your child enjoyed the FRIENDS 

program? 

3.71 

.560 

114 

8. How often do you use the ideas (skills) that you learned in the 

FRIENDS Parent Sessions? 

3.23 

.549 

114 

9. How often does your child use the ideas (skills) that they 

learned in the FRIENDS program? 

3.24 

.519 

117 


Frequencies and percentages of the skills parents found more useful for their children appear on Table 5. On 
average parents endorsed 5.65 items. The two coping skills taught that parents found more useful for their children 
were changing negative thoughts to positive thoughts (75.2%) and recognizing feelings in yourself (64%). The two 
least helpful skills taught were the step plan (34.2%) and the 6-block problem solving plan (32.5%). 


Table 5. Parents' ratings of the skills their child found more useful 


Skill 

Overall 

% (n) 

Relaxation exercises 

54.7% (64) 

Deep breathing 

41 % (48) 

Thinking helpful thoughts 

63.2% (74) 

Changing negative thoughts to positive thoughts 

75.2% (88) 

Step plan 

34.2% (40) 

6-Block problem solving plan 

32.5% (38) 

Recognizing feelings in yourself 

64.1% (75) 

Recognizing feelings in others 

57.3% (67) 

Helping others to feel good 

59% (67) 


3.3 Teachers ’ satisfaction with the AMISTAD para Siempre Program 

Table 6 displays means and standard deviations for teachers' responses to each of the items of the social validity 
questionnaire. Overall, teachers reported that the program was useful for them and for their students; 86.7% 
indicating that they learnt a lot about enhancing resilience in children and adolescents and 73.3% reported that the 
program was very useful for enhancing resilience in their students. 
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Table 6. Teachers' means for each of the items of the Social Validity Questionnaire (4 Very useful/ Very Easy/ 
Very complimentary/ Very Well/ A lot, 1 Not Useful at All/Very Difficult/Not Complimentary At All/Not Well at 
All/ Nothing at All) 


Question 

Mean 

SD 

N 

1. How useful do you think resilience-building programs are for 
children and young people in general? 

2. How useful do you find the FRIENDS program for 

4 

3.87 

.000 

.352 

15 

15 

enhancing the resilience of the children in your class? 

3. How much did you learn about enhancing resilience in 

children and adolescents? 

3.73 

.458 

15 

4. How much do you think the students learned about 
understanding feelings in themselves and others? 

3.27 

.458 

15 

5. How much do you think the students learned about coping 
with these feelings? 

3.07 

.594 

15 

6. How much do you think the students enjoyed the FRIENDS 
program? 

3.60 

.632 

14 

7. How easy did you find to implement the program into your 
class or school setting? 

3.36 

.633 

15 

8. How well did the program complement the existing 
curriculum? 

3.33 

.617 

15 

9. How complementary is the FRIENDS program to the 
school’s overall teaching philosophy? 

3.67 

.488 

14 


3.4 Relationship between Students' Level of Satisfaction with the Program and Intervention Outcome Measures 

Pearson correlations were performed in order to examine the relationship among the post-test scores of the SCAS, 
CDI, Cuestionario de Afrontamiento (CA), risk for anxiety, risk for depression, and students' level of satisfaction 
with the program (See Table 7). 


Table 7. Pearson correlations between the level of student satisfaction with the AMISTAD paraSiempre program 
and the Intervention Outcome Measures 


Question 



Post-test 



SCAS 

CDI 

Coping 

Skills 

Risk for 

Anxiety 

Risk for 

Depression 

1. How much did you enjoy the FRIENDS 
program? 

-.033 

.092* 

.078 

-0.69 

.075 

2. How much did you learn by doing the 
program with your classroom friends? 

.069 

.067 

.025 

.010 

-.004 

3. How much did you learn about feelings? 

.046 

.176** 

.130** 

-.010 

194** 

4. How much did you learn about how to cope 
with feeling worried or upset? 

.073 

.107* 

.119** 

.072 

.046 

5. How often do you use the ideas and skills 
learned in the FRIENDS program? 

-.059 

-.037 

-.006 

-.048 

-.027 


Note: *p<0.05. **p<0.01 


A statistically significant and positive correlation was found between how much did students enjoy the program 
and the CDI (r = 0.09, p = .04). Positive correlations were also found between how much did students learn about 
feelings and the CDI (r = 0.18,/? = .00), the risk for depression (r - 0.19, p = .00), and CA (r - 0.13, p - .01). How 
much did students learn about coping with feeling worried or upset reported a statistically significant and positive 
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correlation with the CDI (r = 0.107, p = .02) and CA (r = 0.12, p = .01). No statistically significant correlations 
were found between the remaining items of the questionnaire and the intervention outcome measures. 

4. Discussion 

The purpose of this study was to evaluate the social validity of the FRIENDS for Life (AMISTAD para Siempre) 
program implemented as a universal school-based strategy for the prevention of anxiety and depression in 
Mexican primary school-aged children. Three areas of social validity were examined: (1) The extent to which 
consumers were satisfied with the program, (2) the extent to which there were gender differences in the ratings of 
techniques and skills learnt in the program, and (3) the possible relationship between the level of students' 
satisfaction with the program and the intervention outcomes. 

Overall, students rated the AMISTAD para Siempre program as enjoyable and helpful to enable them to cope with 
difficult situations. Also, most of the parents and teachers were highly satisfied with the program, indicating that it 
was useful for them and for their children. These findings are similar to results that have been reported with 
Australian, Canadian and German populations (Barrett et al., 2001; Essau et al., 2004; Cooper, 2007). Thus, 
suggesting that the program is likely to be well received in a school setting. 

Results from this study showed that two coping skills that students found more useful were changing negative 
thoughts into positive, and relaxation techniques; in contrast to recognizing feelings in you and helping others to 
feel good. A study from Canada also reported that students found relaxation techniques the most useful (Cooper, 
2007). Relaxation might have been recognized as one of the most useful techniques because of the way it was 
taught; teachers usually give direct and concrete instructions when guiding children to do deep breathing and 
visualization and used music and relaxation pillows, therefore relaxation could have helped students to experience 
emotional and physiological benefits relatively soon (Neil & Christensen, 2009). Other reason could be that 
children rated other techniques (i.e., coping step plan) as less useful because of their developmental level. Usually 
older children or teenagers consider abstract techniques more useful, whereas younger children might need more 
guided practice and visual learning (Barrett, 2008). 

In the same way as children, parents also reported that changing negative thoughts into positive (75.2%) was the 
most useful skill learnt, followed by recognizing your own feelings. The two least helpful skills reported by parents 
were the coping step plan (34.2%) and the six-block problem solving plan (32.5%). This may be because these are 
the two most difficult components of the program that usually required to most modeling and practice at school 
and home (Barrett, 2008a). Also, the fact that only 44% of the parents attended the parents' informational sessions 
could have impacted the results. 

In the study from Barrett, Shortt, Fox, and Wescombe (2001) parents' also rated the six-block problem solving 
plan as the least useful; however, the step plan was rated as the most useful skill, especially when combined with 
self-rewards (positive reinforcement). In Cooper's (2007) study parents also rated changing negative thoughts into 
positive the most useful skills, followed by relaxation techniques. 

Results from the social validity questionnaires for teachers showed that most of them learnt a lot about enhancing 
resilience in their students, and that the program was very useful for them. This is a promising finding as schools 
have been regarded as one of the best settings to implement prevention programs, where a large number of children 
could be reached during a short period of time (Gladstone & Beardslee, 2009; Neil & Christensen, 2009). Thus, 
opening the possibility of delivering prevention programs as a cost effective strategy in which more children that 
cannot afford mental health services due to financial or social reasons can now be reached (Costello & Angold, 
1996; Cooper, 2007). 

Regarding gender differences in the rating of skills and techniques, this study showed that girls rated the AMISTAD 
para Siempre program as more useful and enjoyable, when compared to boys. However, no statistically 
significant differences were found in the rating of specific skills or techniques. Similar results were found in 
Cooper's study (2007) and might possibly be explained by the fact that during childhood, girls rated higher in their 
social and emotional skills than boys (Burges, 2006). Girls also tend to outperform men in perceptual speed, verbal 
fluency, and recall details, and often start their language development earlier than boys (Binges, 2006). 

When examining the possible relationship between the level of students' satisfaction with the program and the 
intervention outcomes, a statistically significant and positive correlation between how much did students enjoy the 
program and their depressive symptoms as rated by the CDI, The more children enjoyed the program the lower the 
scores on the depression scale. Positive correlations were also found between how much did students learnt about 
feelings and their depressive symptoms, risk for depression and coping skills. These are very important findings 
that pointed out the importance of including social validity as a crucial aspect to take into account when delivering 
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and evaluating prevention programs. Some aspects of social validity could also be predictors of intervention 
outcomes and it would be very interested to booster them during program implementation. 

In general, the objectives of the program were reached. Students, teachers, and parents evaluated the program as 
helpful and satisfying. The study allowed for obtaining knowledge about the consumer’s satisfaction of the 
program and to explore if there were gender differences in the ratings of techniques and skills learnt in the program. 
According to the results, the study has social validation. The results also suggest that the level of satisfaction and 
the intervention outcomes are likely to be dependent, meaning that the perceived acceptability of the intervention 
is a significant predictor of outcome. 

5. Strengths of the Study 

The present study is the first to examine the social validity of the FRIENDS for Life program with Mexican 
children. In addition to social validity measures, the study has the strength of including outcome measures to 
explore correlations between children's satisfaction and scores on depression, anxiety and coping skills scales. 

Noteworthy is the fact that this study included all consumers: children, parents and teachers. Thus providing a 
more ecological vision of how the program was received. To our knowledge, this is the only study that has 
included three consumers when evaluating the social validity of the FRIENDS for Life program. 

6. Limitations and Further Research 

In this study, outcome measures did not reflect a balance for risk and protective factors. This study would have 
benefitted by evaluating other positive aspects such as resilience, self-esteem, optimism, and quality of peer 
relationships and explore the relationship between satisfaction with the program and direction of change in 
protective factors. Most studies that evaluate prevention programs are now including these kinds of measures to 
provide a more global picture of how the program might work (Dozois&Westra, 2004; Fisak, Richard, & Mann, 
2011). 

Another limitation was the amount of parental involvement during the implementation of the program and 
measurement time points. Based on resilience and prevention research, parent involvement is critical for program 
effectiveness and additional benefits for those receiving the program. Further studies should incorporate effective 
strategies for increasing parental involvement. 

Although, all schools were randomly selected from a pool of public schools of similar SES level, no more 
information besides typical demographic data was collected. This study would have benefitted from information 
regarding levels of community violence, level of education of parents and marital status, number of family 
members, and ideally assessing anxiety and depression in parents. Further studies should also gather more 
information regarding participants in order to generalize the findings and to identify possible predictors of 
outcome. 

Another limitation of this study is that no information was gathered regarding children's attendance and homework 
task completion. Further studies should include this as there could have an impact in the satisfaction, enjoyment, 
and acquiring of the skills taught by the program. Follow-up measures should also be incorporated in further 
research in order to evaluate if gains are maintained. 

7. Conclusion 

This is the first study that evaluates the social validity of the AMISTAD paraSiempre program implemented as a 
universal school-based strategy for the prevention of anxiety and depression in Mexican primary school-aged 
children. Results from this study are promising and showed that Mexican children as well their teachers and 
parents regarded the AMISTAD paraSiempre program as useful and enjoyable. The skill that students and parents 
found more useful was changing negative thoughts into positive. Girls reported the program as more useful and 
enjoyable than boys, however there were no differences found in the ratings of scales. Positive correlations were 
found between some items of the social validity measure and symptoms of depression, anxiety and coping skills; 
thus, pointing out an important research area to explore. Further studies should include more positive measures and 
should increase parental involvement. 
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